Determining and characterizing the reused text for plagiarism detection

An important task in plagiarism detection is determining and measuring similar text portions between a given pair of documents. One of the main difficulties of this task resides on the fact that reused text is commonly modified with the aim of covering or camouflaging the plagiarism. Another difficulty is that not all similar text fragments are examples of plagiarism, since thematic coincidences also tend to produce portions of similar text. In order to tackle these problems, we propose a novel method for detecting likely portions of reused text. This method is able to detect common actions performed by plagiarists such as word deletion, insertion and transposition, allowing to obtain plausible portions of reused text. We also propose representing the identified reused text by means of a set of features that denote its degree of plagiarism, relevance and fragmentation. This new representation aims to facilitate the recognition of plagiarism by considering diverse characteristics of the reused text during the classification phase. Experimental results employing a supervised classification strategy showed that the proposed method is able to outperform traditionally used approaches. This work was done under partial support of CONACyT project grants: (XXXX), and scholarships: (XXXX) Principal corresponding author Corresponding author Email addresses: [email protected] (Fernando Sánchez-Vega), [email protected] (Esaú Villatoro-Tello), [email protected] (Manuel Montes-y-Gómez), [email protected] (Luis Villaseñor-Pineda), [email protected] (Paolo Rosso) Preprint submitted to Expert Systems with Applications June 21, 2012